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A  Novel  Hand-Held  Optical  Imager  with  real-Time  Coregistration  Facilities 

toward  Diagnostic  Mammography 


Annual  Report  (Year  1,  Jan  2009-Dec  2009) 

PI:  Sarah  J.  Erickson  (sericOO  1  @fiu.edu) 

Contact  Details:  Doctoral  Student,  Department  of  Biomedical  Engineering 
College  of  Engineering  and  Computing,  Florida  International  University,  Miami,  FL 
Grant  No.  BC083282 

Mentor:  Dr.  Anuradha  Godavarty  ( godavart@fiu.edu) 


INTRODUCTION 


Optical  imaging  using  near-infrared  (NIR)  light  is  an  emerging  technique  toward  non-invasive 
breast  cancer  diagnosis.  Hand-held  based  optical  imaging  devices  are  currently  developed 
toward  clinical  translation  of  the  technology.1  However,  the  NIR  devices  developed  to  date  have 
not  attempted  three-dimensional  (3D)  tomography  since  they  are  not  able  to  accurately  coregister 
the  image  to  the  geometry  of  the  object.  The  overall  goal  of  the  research  is  to  implement  and 
test  a  novel  hand-held  based  optical  imager  with  capabilities  of  automated  coregistration  on 
any  tissue  curvature  for  real-time  surface  imaging  and  3D  tomographic  analysis,  on  tissue 
phantoms  and  in  vivo  with  human  subjects.  The  purpose  for  this  research  is  to  translate  the 
device  to  the  clinical  setting  for  breast  cancer  imaging.  The  scope  of  the  research  involves 
experimental  studies  on  tissue  phantoms  and  in  vitro,  and  in  vivo  studies  with  normal  human 
subjects  prior  to  clinical  studies  with  breast  cancer  patients. 


BODY 


The  tasks  that  were  completed  in  Year-1  of  the  proposed  projects  are  described  herein.  The  tasks 
were  categorized  according  to  three  specific  aims  as  outlined  in  the  statement  of  work: 

Specific  Aim#  1: 

Demonstrate  imaging  and  3-D  tomography  using  hand-held  probe  on  different  curved 
tissue  phantoms. 

Work  Completed  to  Date: 

Proposed  Task  A:  Modify  probe  design  to  achieve  uniform  source  intensity. 

The  current  design  of  the  hand-held  device  (shown  in  Figure  1)  utilizes  a  single  laser  diode 
source  and  a  custom  built  collimator  package  which  divides  the  laser  light  among  six  optical 
fibers  attached  to  the  probe  face.  The  limitation  of  this  design  is  that  the  output  intensity  of  the 
laser  light  is  not  divided  equally  among  the  six  fibers.  The  goal  of  this  task  was  to  modify  the 
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collimator  package  in  order  to  achieve  the  desired  unifonn  source  intensity  distribution. 
However,  during  the  course  of  this  task,  it  was  found  that  achieving  uniform  intensity 
distribution  is  difficult  using  a  single  laser  diode.  Hence,  a  new  design  was  developed  to  use  six 
laser  diodes  individually  attached  to  the  six  optical  fibers  which  can  be  adjusted  individually  to 
the  desired  intensity.  This  design  is  currently  carried  out  in  a  parallel  project  by  a  team  of 
graduate  and  undergraduate  students  in  our  lab  and  will  be  implemented  with  the  second 
generation  of  the  optical  imaging  system. 


Figure  1.  The  three  major  components  of  the  hand-held  device  (left)  are  the  hand-held 
probe,  the  intensified  charge -coupled  device  (ICCD)  camera  detector,  and  the  laser  diode 
source.  The  light  from  the  single  laser  diode  source  is  divided  via  a  collimator  package 
into  six  source  fibers  at  the  probe  face  (right). 

Proposed  Task  B:  Perform  experiments  using  the  hand-held  probe  in  the  curved  position  on 
curved  tissue  phantoms. 

Experiments  were  carried  out  using  the  probe  in  the  maximum  curved  position  (45°  curvature  of 
each  wing)  on  octagonal  phantoms  designed  to  fit  the  curvature  of  the  probe  with  full  contact. 
During  these  studies,  it  was  found  that  there  was  interference  in  the  collected  signal  due  to  the 
sharp  edges  of  the  octagonal  phantom.  These  studies  were  discontinued.  Further  studies  focused 
directly  on  human  breast  tissues  to  demonstrate  imaging  of  curved  geometries  in  the  realistic 
case.  In  vivo  studies  were  performed  on  normal  human  subjects  to  demonstrate  the  feasibility  of 
using  the  hand-held  device  to  perform  fast  2D  imaging  toward  target  detection  prior  to  3D 
tomography  studies.  The  device  was  used  to  collect  images  of  a  fluorescent  target  with  a 
background  of  real  human  breast  tissue.  Fast  imaging  was  performed  in  near  real  time  (~5  sec). 
All  human  subject  studies  were  approved  by  the  Florida  International  University  Institutional 
Review  Board.  Healthy  female  volunteers  age  21  and  above  were  recruited  for  the  studies.  A 
fluorescent  target  (acrylic  sphere  filled  with  1  liM  indocyanine  green)  was  used  to  simulate  a 
tumor  and  was  placed  underneath  the  flap  of  the  breast  tissue  (i.e.  between  breast  tissue  and  chest 
wall,  underneath  the  tissue).  Table  1  gives  a  summary  of  the  in  vivo  experimental  cases 
performed. 


5 


Table  1  Summary  of  experimental  cases  performed  for  in  vivo  fast  2D  imaging  studies. 


Experimental  Case  # 

Number  of 
Targets 

Target  Depth 
(cm) 

Target 
Volume  (cc) 

T:B  Contrast 
Ratio 

in  vivo  with  normal 
human  subject 

1 

1 

2.5 

0.23 

1:0 

2 

1 

2.5 

0.45 

1:0 

3 

2 

2.5 

0.23  &  0.45 

1:0 

Figure  2  shows  the  results  of  images  (i.e.  2D  surface  contour  plots  of  fluorescence  intensity) 
collected  with  the  probe  in  both  the  flat  (Figure  2A)  and  curved  (Figure  2B)  position.  When  the 
probe  was  in  the  flat  position,  it  was  placed  with  gentle  compression  against  the  tissue  surface  to 
allow  full  contact  with  the  probe  face,  whereas  in  the  curved  position  it  was  able  to  contour 
around  the  tissue  in  its  natural  shape. 


Probe 

Position 


F^' 


Target  @ 
4  o'clock 


r 


Probe 

Position 


Target© 
8  o'clock 


Target  Volume:  0.23  cc  | 


4 

3 

2 

1 


2  4  6  8 


Target  Volume:  0.45  cc 


2  4  6  8 


(A) 


(B) 


Figure  2.  Results  for  in  vivo  studies  with  normal  human  subjects.  (A)  0.23  cc  target  was 
placed  at  the  4  o’clock  position  and  imaged  with  the  probe  in  the  flat  position.  (B)  0.45 
cc  target  was  placed  at  the  8  o’clock  position  and  imaged  with  the  probe  in  the  curved 
position. 


The  results  show  that  a  fluorescent  target  was  detectable  through  ~2.5  cm  of  actual  human 
breast  tissue  using  the  probe  in  both  the  flat  and  curved  positions.  The  results  for  these  studies 
were  published  in  Translational  Oncology  and  the  article  in  press  is  attached  in  Appendix  A. 
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Specific  Aim  #  2: 

Implement  3-D  automated  co-registration  using  acoustic-based  tracking  system  in  order  to 
perform  real-time  in-vivo  optical  imaging. 

Work  Completed  to  Date: 

Proposed  Task  A:  Implement  a  3D  motion  tracking  device  in  order  to  randomly  track  the 
movement  of  the  hand-held  probe. 

Coregistered  imaging  is  required  in  order  to  perform  3D  tomography  since  the  2D  image  must  be 
located  in  the  exact  position  of  the  hand-held  probe  on  the  tissue  surface.  A  3D  tracking  system 
was  implemented  on  the  probe  in  order  to  perfonn  coregistered  imaging  using 
MATLAB/LabView  software  developed  by  a  master’s  student  in  house.  Experimental  studies 
using  an  exogenous  fluorescent  contrast  agent  Indocyanine  Green  (ICG)  were  perfonned  to 
demonstrate  the  feasibility  of  coregistered  imaging  using  the  hand-held  probe  based  optical 
imager.  The  contrast  agent  is  placed  in  a  small  spherical  target  and  embedded  within  the 
phantom  to  represent  a  tumor  within  a  tissue  background.  Successful  implementation  of  the 
coregistered  tracking  method  would  be  indicated  by  the  ability  to  track  the  actual  location  of  the 
target  as  the  probe  is  moved  to  different  positions  with  respect  to  the  phantom  surface. 
Coregistered  imaging  was  demonstrated  in  slab  tissue  phantoms  (composed  of  1%  Liposyn)  and 

•5 

the  results  published  in  Review  of  Scientific  Instruments  (article  in  press  is  attached  in  Appendix 
B).  Additional  experiments  were  performed  in  phantoms  composed  of  minced  chicken  breast 
combined  with  1%  Liposyn  to  demonstrate  coregistered  imaging  in  vitro,  and  the  results  were 
published  in  Review  of  Scientific  Instruments  (Appendix  B).3  The  results  showed  that  the  3D 
tracking  system  was  able  to  track  the  position  of  the  probe  in  real-time  and  accurately 
coregister  the  image  to  the  geometry  of  the  object  in  tissue  phantoms  and  in  vitro.  During 
these  coregistered  imaging  studies,  it  was  found  that  by  collecting  multiple  coregistered  images 
and  applying  a  post-processing  summation  technique,  a  target  can  be  detected  at  greater  depths 
than  with  a  single  image  alone.  A  0.45  cm  target  was  detected  at  a  depth  of  3.0  cm  in  the  slab 
tissue  phantom,  and  a  0.45  cm3  target  was  detected  at  a  depth  of  2.5  cm  in  the  in  vitro  phantom.3 
These  results  show  that  by  summating  multiple  coregistered  images ,  deeper  targets  can  be 
detected.  Ongoing  studies  are  currently  perfonned  to  detennine  the  deepest  and  smallest  size 
target  that  can  be  detected  using  this  technique. 

Proposed  Task  B:  Adapt  and  improve  3D  reconstruction  tools  for  optical  tomography  studies. 
This  task  is  part  of  ongoing  research  to  be  completed  in  subsequent  years. 
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Specific  Aim  #  3: 

Perform  feasibility  in-vivo  studies  using  diffuse  optical  imaging  on  normal  subjects  to 
demonstrate  real-time  co-registered  imaging. 

Proposed  Task  A:  Perform  in-vivo  studies  with  ~5  normal  human  subjects  at  Florida 
International  University. 

This  task  is  part  of  ongoing  research  to  be  completed  in  subsequent  years. 

Proposed  Task  B:  Implement  the  tracking  system  to  obtain  real-time  surface  images  of  the 
human  breast  tissues  using  the  hand-held  opticcd  imager. 

This  task  is  part  of  ongoing  research  to  be  completed  in  subsequent  years. 

Training  Plan: 

Instrumentation  and  Phantom  Studies: 

The  P.I.  trained  under  a  previous  doctoral  student  to  learn  how  to  operate  the  imaging  system  and 
carry  out  experiments  using  tissue  phantoms. 

In  Vivo  Studies 

The  P.I.  received  training  from  Sylvester  Cancer  Center  under  Dr.  Richard  Kiszonas.  The 
training  involved  observing  breast  imaging  (i.e.  x-ray  mammography  and  breast  ultrasound)  and 
interacting  with  doctors  and  technicians  in  the  clinical  setting. 

Mentoring 

During  Year-1  the  P.I.  mentored  two  undergraduate  students  in  performing  in  vivo  studies,  a 
third  undergraduate  student  in  instrumentation,  and  a  master’s  student  in  coregistered  imaging 
and  instrumentation. 


KEY  RESEARCH  ACCOMPLISHMENTS 


■  Demonstrated  fast  2D  imaging  using  the  hand-held  device  on  curved  tissue  geometries  in 
normal  human  subjects. 

(Specific  Aim  #1) 

■  Detected  fluorescent  targets  in  vivo  within  actual  human  breast  tissue. 

(Specific  Aim  #1) 

■  Implemented  3D  tracking  system  and  demonstrated  coregistered  imaging  using  the  hand¬ 
held  device  on  tissue  phantoms  and  in  vitro. 

(Specific  Aim  #2) 

■  Detected  deeper  targets  by  applying  multi-scan  summation  technique  using  coregistered 
images. 

(Specific  Aim  #2 
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CONCLUSION 


The  objectives  outlined  in  the  statement  of  work  that  have  been  completed  to  date  are  Specific 
Aim  #1  and  part  of  Specific  Aim  #2.  The  major  outcomes  from  these  tasks  are:  (i) 
demonstration  of  fast  2D  imaging  using  the  hand-held  device  on  curved  tissue  geometries  and 
detection  of  a  fluorescent  target  in  actual  human  breast  tissue,  (ii)  implementation  of  a  3D 
tracking  system  and  demonstration  of  coregistered  imaging  using  the  hand-held  device  on  tissue 
phantoms  and  in  vitro,  and  (iii)  detection  of  deeper  targets  using  summation  of  multiple 
coregistered  images.  The  results  obtained  were  published  in  the  peer-reviewed  journals 
Translational  Oncology  and  Review  of  Scientific  Instruments  and  presented  at  the  national 
meetings  SPIE  Photonics  West  and  Southeastern  Biomedical  Engineering  Conference. 

The  results  from  these  tasks  demonstrate  the  ability  of  the  hand-held  device  to  image  in  human 
breast  tissues  which  have  complex  geometries,  whereas  previous  studies  used  slab  phantoms 
with  simple  geometries.  A  fluorescent  target  was  detected  in  vivo  through  human  breast  tissue 
which  demonstrates  the  potential  of  the  device  to  detect  a  tumor  in  the  clinical  setting.  A 
tracking  system  was  implemented  with  the  hand-held  device  and  coregistered  imaging  was 
demonstrated  on  tissue  phantoms  and  in  vitro.  These  results  demonstrate  the  ability  of  the  device 
to  accurately  coregister  the  image  to  the  geometry  of  the  object  and  hence  the  potential  of  the 
device  to  perform  3D  tomographic  imaging  in  human  subjects  via  coregistered  imaging  on 
complex  geometries. 
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Abstract 

Near-infrared  (NIR)  optical  imaging  is  a  noninvasive  and  nonionizing  modality  that  is  emerging  as  a  diagnostic  tool 
for  breast  cancer.  The  handheld  optical  devices  developed  to  date  using  the  NIR  technology  are  predominantly 
developed  for  spectroscopic  applications.  A  novel  handheld  probe-based  optical  imaging  device  has  been  recently 
developed  toward  area  imaging  and  tomography  applications.  The  three-dimensional  (3D)  tomographic  imaging 
capabilities  of  the  device  have  been  demonstrated  from  previous  fluorescence  studies  on  tissue  phantoms.  In 
the  current  work,  fluorescence  imaging  studies  are  performed  on  tissue  phantoms,  in  vitro,  and  in  vivo  tissue  mod¬ 
els  to  demonstrate  the  fast  two-dimensional  (2D)  surface  imaging  capabilities  of  this  flexible  handheld-based 
optical  imaging  device,  toward  clinical  breast  imaging  studies.  Preliminary  experiments  were  performed  using  tar¬ 
gets)  of  varying  volume  (0.23  and  0.45  cm3)  and  depth  (1-2  cm),  using  indocyanine  green  as  the  fluorescence 
contrast  agent  in  liquid  phantom,  in  vitro,  and  in  vivo  tissue  models.  The  feasibility  of  fast  2D  surface  imaging 
(~5  seconds)  over  large  surface  areas  of  36  cm2  was  demonstrated  from  various  tissue  models.  The  surface 
images  could  differentiate  the  target(s)  from  the  background,  allowing  a  rough  estimate  of  the  target's  location 
before  extensive  3D  tomographic  analysis  (future  studies). 
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Introduction 

Handheld-based  optical  imaging  devices  have  been  developed  for 
breast  imaging  to  accelerate  the  clinical  translation  of  the  technology 
toward  cancer  diagnosis.  Several  of  these  handheld  devices  have  been 
tested  in  vivo  on  human  subjects  [1  2  3  4  5,  selected  publications]. 
However,  they  are  unable  to  contour  to  the  curvature  of  human 
breast  tissue  because  all  these  devices  used  flat-probe  faces.  The  pre¬ 
dominant  applications  to  date  have  been  either  toward  spectroscopic 
measurement  of  tissue  optical  properties  or  two-dimensional  (2D) 
localization  studies  of  abnormal  tissue  within  the  breast.  Recently, 
a  handheld  optical  imaging  device  has  been  developed  in  our  Optical 
Imaging  Laboratory  [6]  toward  imaging  large  tissue  surfaces  using  a 
flexible  probe  face  that  contours  to  different  tissue  curvatures.  The 
device  is  intended  to  augment  current  clinical  imaging  modalities 
for  breast  cancer  detection  and  diagnosis.  The  three-dimensional 
(3D)  tomographic  ability  of  the  device  has  been  demonstrated  on 
large  tissue  phantoms  using  a  fluorescence-enhanced-based  imaging 
technique  [7].  Herein,  preliminary  studies  are  performed  on  tissue 
phantoms,  in  vitro,  and  in  vivo  tissue  models  to  demonstrate  the  fast 
2D  surface  imaging  capabilities  of  this  flexible  handheld-based  opti¬ 
cal  imaging  device  toward  clinical  breast  imaging  studies. 


Materials  and  Methods 

Instrumentation 

The  instrumentation  for  the  handheld  optical  imaging  device  con¬ 
sists  of  a  785-nm,  500-mW  laser  diode  source  and  an  intensified 
charge-coupled  device  (ICCD)  camera  detector  (with  550-850  nm 
bandwidth  at  the  intensifier  end)  as  shown  in  Figure  1.  The  source 
light  is  launched  onto  and  collected  from  the  tissue  surface  using  a 
handheld-based  probe  head  (4  x  9-cm2  imaging  area).  The  handheld 
probe  consists  of  6  points  of  illumination  and  165  points  of  collec¬ 
tion  (as  shown  in  Figure  2)  of  optical  signals  through  optical  fibers, 
which  connect  the  probe  head  to  the  source  and  detector.  The  total 
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Q3  Figure  1.  Handheld  probe-based  optical  imaging  system  showing  the  handheld  probe  is  fiber-optically  coupled  to  the  laser  source  and 
ICCD  camera  (left).  The  probe  face  is  flexible  to  contour  to  different  tissue  curvatures  (right). 


laser  power  incident  on  the  phantom  or  tissue  is  <10  mW.  The  de¬ 
vice  has  a  flexible  probe  head  design  such  that  it  contours  to  different 
tissue  curvatures  during  imaging.  Simultaneous  illumination  and  de¬ 
tection  from  multiple  point  locations  is  carried  out  to  reduce  the 
overall  imaging  time.  Additional  details  of  the  instrumentation  are 
provided  elsewhere  [7].  The  instrumentation  is  developed  such  that 
it  can  acquire  both  continuous  wave  (CW)-based  and  frequency- 
domain-based  optical  measurements  as  required.  To  facilitate  2D 
imaging  in  real  time,  the  device  was  operated  in  the  CW  mode  for 
the  current  study  in  tissue  phantoms,  in  vitro ,  and  in  vivo. 

Data  Acquisition  and  Analysis 

Two-dimensional  surface  imaging  was  performed,  using  the  hand¬ 
held  device  operated  in  the  CW  mode,  on  tissue  phantoms,  in  vitro, 
and  in  vivo  tissue  models.  In  all  cases,  fluorescence-enhanced  imaging 
was  performed  using  an  external  fluorescing  agent  indocyanine  green 
(ICG)  for  improved  contrast.  Spherical  acrylic  targets  (of  different 
sizes)  filled  with  1  pM  ICG  were  used  to  mimic  a  tumor.  The  target 
was  placed  at  different  depths  from  the  imaging  surface  and  different 
target-to-background  (T:B)  contrast  ratios  (1:0  and  100:1)  were  used 
for  different  experimental  cases.  The  probe  was  placed  in  contact 
with  the  phantom  or  tissue  surface  as  shown  in  Figure  3,  and  CW 
images  of  the  fluorescent  intensity  were  acquired  in  close  to  real  time 
(~2  seconds’  delay).  The  raw  fluorescence  intensity  images  at  the 
ICCD  camera  end  were  acquired  in  1  second  (0.2-second  exposure 
time  x  5  repetitions).  These  images  were  postprocessed  (~1  second) 
using  in-house  developed  Matlab  codes  to  acquire  the  final  2D  sur¬ 
face  contour  plots  of  fluorescence  intensity  distribution  of  the  imaged 
surface.  The  entire  data  acquisition  and  postprocessing  were  auto¬ 
mated  such  that  close  to  real-time  (~2  seconds’  delay)  imaging  is  pos¬ 
sible.  The  2D  surface  contour  plots  of  fluorescence  intensity  signal 
may  or  may  not  differentiate  the  target  from  the  tissue  phantom 
background,  based  on  the  target  and  background  optical  properties. 

During  fluorescence  optical  imaging,  the  output  signal  at  the  tis¬ 
sue  surface  is  a  mixture  of  fluorescence  signal  and  the  attenuated  in¬ 
cident  near-infrared  (NIR)  (i.e.,  excitation)  signal.  This  fluorescence 
signal  is  filtered  from  the  strong  excitation  signal  (three  to  four  orders 
of  magnitude  higher)  using  appropriate  optical  (band-pass)  filters  and 
imaged  by  the  detector.  However,  the  filters  are  not  capable  of  100% 
rejection  of  the  excitation  light,  causing  an  excitation  leakage  and 
contamination  of  the  fluorescent  signal.  Hence,  a  second  level  of 
postprocessing  is  carried  out  to  subtract  a  background  nonfluorescing 
image  from  the  final  fluorescence  image  plots  for  each  experimental 


case  to  account  for  the  excitation  leakage.  Initially,  optical  measure¬ 
ments  were  acquired  before  placing  the  fluorescent  target  in  the 
phantom,  in  an  attempt  to  represent  the  excitation  leakage  (or  back¬ 
ground  noise).  These  (background  noise)  measurements  were  sub¬ 
tracted  from  the  fluorescence  optical  measurements  obtained  from 
experimental  cases  that  included  fluorescent  targets  to  effectively 
eliminate  the  signal  from  the  excitation  source  light.  In  the  clinical 
setting  involving  actual  diseased  tissues  (unlike  the  simulated  fluores¬ 
cent  targets  in  the  current  study),  this  could  be  accomplished  by  ac¬ 
quiring  image(s)  of  the  tissue  before  and  after  the  contrast  agent  (e.g., 
ICG)  injection.  The  nonfluorescent  image(s)  acquired  before  ICG 
injection  will  in  turn  be  subtracted  from  the  fluorescent  images  ac¬ 
quired  after  ICG  injection  to  account  for  the  background  noise. 

The  subtracted  2D  fluorescence  images  are  generated  rapidly  (<5  sec¬ 
onds),  making  the  entire  process  a  fast  2D  surface  imaging  tech¬ 
nique.  The  acquisition  of  these  subtracted  fluorescence  2D  surface 
contour  plots  has  greater  significance  in  2D  target  localizations  as 
well  as  in  3D  tomographic  imaging  studies. 

Experimental  Cases 

Tissue  phantom  studies.  Studies  were  performed  using  slab  tissue 
phantoms  composed  of  10  x  10  x  10-cm3  acrylic  cubes  filled  with 
650  ml  of  1%  Liposyn  solution  (Liposyn  II,  20%;  Henry  Schein, 
Melville,  NJ)  to  mimic  the  optical  properties  of  a  typical  breast  tissue. 
The  fluorescent  target  was  placed  at  different  depths  (1.5-2. 5  cm)  from 


Figure  2.  Picture  of  the  handheld  probe  face  showing  the  source- 
detector  configuration.  The  large  red  dots  represent  the  six  source 
fiber  locations,  and  all  other  small  holes  are  the  165  detector  fi¬ 
ber  locations. 
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Figure  3.  Experimental  setup  for  tissue  phantom,  in  vitro,  and  in  vivo  studies:  (A)  empty  phantom  showing  target  inclusion  and  place¬ 
ment  of  probe,  (B)  tissue  slab  phantom  with  1  %  Liposyn  solution  for  uniform  scattering  in  the  background,  (C)  in  vitro  slab  phantom  with 
heterogeneous  scattering  in  the  background,  and  (D)  setup  for  in  vivo  studies  using  mannequin  (for  demonstration  only)  to  represent 
human  subject. 


the  imaging  surface  and  real-time  as  well  as  fast  (subtracted)  images  of 
fluorescence  intensity  were  acquired.  The  different  experimental  cases 
are  summarized  in  Table  1. 

In  vitro  phantom  studies.  Before  in  vivo  studies  with  human  sub¬ 
jects,  experiments  were  performed  using  in  vitro  phantoms,  which 
were  composed  of  minced  chicken  breast  combined  with  1  %  Liposyn 
solution,  to  introduce  a  nonuniform  scattering  background.  The 
in  vitro  mixture  of  minced  chicken  breast  (480  ml)  and  1%  Liposyn 
(260  ml)  was  placed  inside  a  10  x  10  x  10-cm3  acrylic  cube.  Real¬ 
time  as  well  as  fast  (subtracted)  images  of  fluorescence  intensity 
were  acquired  under  different  experimental  conditions  using  either 
a  0.23-cm3  or  0.45  -cm3  fluorescent  target  located  at  various  depths 
between  1  and  2  cm  (Table  1). 

In  vivo  studies.  In  vivo  studies  were  performed  on  healthy  human 
subjects  to  demonstrate  the  feasibility  of  using  the  handheld  device  to 
collect  images  of  a  fluorescent  target  with  a  background  of  real  hu¬ 


man  breast  tissue.  All  human  subject  studies  were  approved  by  the 
Florida  International  University  Institutional  Review  Board.  Healthy 
female  volunteers  aged  21  and  older  were  recruited  for  the  studies.  A 
fluorescent  target  was  used  to  simulate  a  tumor  (as  described  in  Data 
Acquisition  and  Analysis)  and  was  placed  underneath  the  flap  of  the 
breast  tissue  (i.e.  between  breast  tissue  and  chest  wall,  underneath  the 
tissue).  In  the  first  study,  a  0.23-cm3  sphere  with  1  pM  ICG  was 
placed  under  the  right  breast  in  the  4-o’clock  position.  The  flat-probe 
face  was  placed  against  the  breast  tissue  with  gentle  compression,  and 
a  real-time  fluorescent  intensity  image  was  acquired  (around  the  tar¬ 
get  region).  The  depth  of  the  target  within  the  tissue  was  approxi¬ 
mately  2.5  cm  as  measured  with  a  vernier  caliper. 

A  second  study  was  performed  using  a  single  target  with  the  probe 
in  the  maximum  curved  position  (i.e.,  45°  curvature  of  the  two  side 
plates  of  the  three-plate-based  probe  face).  The  images  collected  with 
the  probe  in  the  curved  position  possibly  include  transilluminated 
measurements  in  addition  to  reflectance-based  measurements.  This 
study  was  performed  to  demonstrate  the  feasibility  of  using  the  probe 


Table  1.  Summary  of  Experimental  Cases  for  Slab  Tissue  Phantom,  In  Vitro,  and  In  Vivo  Studies. 


Subject  Studied 

Experiment  No. 

Number  of  Targets 

Target  Depth  (cm) 

Target  Volume  (cm3) 

T:B  Contrast  Ratio 

Slab  tissue  phantom  (uniform  scattering  in  background) 

1 

1 

1.5 

0.45 

1:0 

2 

1 

2.0 

0.45 

1:0 

3 

1 

2.5 

0.45 

1:0 

In  vitro  phantom  (nonuniform  scattering  in  background) 

4 

1 

1.0 

0.45 

1:0 

5 

1 

1.5 

0.45 

1:0 

6 

1 

2.0 

0.45 

1:0 

7 

1 

1.0 

0.23 

1:0 

8 

1 

1.5 

0.23 

1:0 

9 

1 

2.0 

0.23 

1:0 

In  vitro  with  healthy  human  subject 

10 

1 

2.5 

0.23 

1:0 

11 

1 

2.5 

0.45 

1:0 

12 

2 

2.5 

0.23  and  0.45 

1:0 
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Figure  4.  Near  real-time  images  of  fluorescence  intensity  obtained  as  2D  surface  contour  plots  acquired  from  slab  phantoms  (with 
uniform  background  scattering).  The  fluorescent  target  was  placed  at  different  locations  and  depths:  (A)  target  location  (x,y,z)  = 
(2.0,  2.7,  1.5),  and  (B)  target  location  ( x,y,z )  =  (2.0,  2.7,  2.0),  and  (C)  target  location  ( x,y,z )  =  (3.0,  2.2,  2.5).  The  black  hollow  circle  in 
each  subplot  is  the  true  target  location. 


in  its  curved  position,  such  that  it  can  contour  along  the  tissue  and 
also  provide  fluorescent  images  that  can  aid  in  target  detection.  Herein, 
a  0.45-cm3  fluorescent  target  containing  1  |iM  ICG  was  placed  under 
the  right  breast  in  the  8-o’clock  position.  A  real-time  as  well  as  fast 
(subtracted)  image  of  fluorescence  intensity  was  acquired  by  applying 
gentle  compression  along  the  tissue  curvature. 

A  third  study  was  performed  to  demonstrate  the  feasibility  of  imag¬ 
ing  multiple  targets  within  real  human  breast  tissue.  Two  targets  were 
placed  under  the  fold  of  the  left  breast  tissue,  with  a  0.23-cm3  target 
at  the  6-o’clock  position,  and  a  0.45-cm3  target  was  placed  at  the 
8-o’clock  position  of  the  same  breast.  A  real-time  as  well  as  fast  (sub¬ 
tracted)  image  of  fluorescence  intensity  was  acquired  by  applying  gen¬ 
tle  compression  on  the  left  breast  tissue. 

All  these  preliminary  in  vivo  studies  used  micromolar  concentra¬ 
tions  of  ICG  in  the  tumor-mimicking  target(s),  similar  to  the  current 
tissue  phantom,  in  vitro  phantom  studies,  and  also  that  used  by  other 
researchers  [7-9].  The  actual  in  vivo  studies  on  breast  cancer  subjects 
cannot  estimate  the  concentration  of  ICG  (after  injection)  at  the 
tumor  site,  and  the  researchers  typically  report  the  injected  quantities 
of  the  contrast  agent  [8,10], 

Results 

Tissue  Phantom  Studies 

Real-time  images  using  the  slab  phantom  with  uniform  scattering 
in  the  background  are  shown  in  Figure  4  as  2D  surface  contour  plots 
of  the  fluorescence  intensity  data  with  a  target  placed  at  different 
depths  (1.5-2. 5  cm)  from  the  imaging  surface.  The  nonuniform  in¬ 
tensity  distribution  in  Figure  4  is  possibly  due  to  the  residual  exci¬ 


tation  leakage  around  the  six  source  fibers  (after  the  implementation 
of  the  subtraction  technique).  In  addition,  the  input  laser  source  sig¬ 
nal  is  not  evenly  distributed  among  the  six  source  fibers,  possibly 
causing  a  variation  or  nonuniformity  in  the  output  fluorescence  in¬ 
tensity  distribution. 

The  images  show  the  feasibility  of  performing  (close  to)  real-time 
2D  imaging  using  the  handheld  device  in  tissue  phantoms.  The  ac¬ 
tual  target  location  in  the  images  is  indicated  in  the  figures  by  the 
black  open  circle  in  the  x-y  plane  for  different  target  depths  in  the 
“z”  direction.  The  fast  2D  image  estimates  the  2D  target  location 
(instantly)  in  the  x-y  plane.  This  information  can  then  be  further 
used  toward  3D  tomography  (in  the  future)  to  determine  the  tumor 
volume,  location,  and  depth  [9]. 

From  these  plots,  it  is  obvious  that  the  real-time  images  are  capable 
of  differentiating  the  target  from  the  background  when  the  0.45-cm3 
target  was  1.5  cm  deep.  At  greater  tissue  depths,  the  target  was  not 
distinctly  differentiable  because  of  the  strong  excitation  leakage  from 
the  background.  On  applying  the  subtraction  technique  (as  described 
in  Data  Acquisition  and  Analysis),  the  target  is  clearly  differentiable 
from  the  background  in  all  the  experimental  cases  (Figure  5).  These 
subtracted  images  also  have  potential  to  obtain  3D  target  localiza¬ 
tion  through  tomographic  imaging,  as  long  as  the  probe’s  location 
on  the  tissue  surface  is  coregistered  with  respect  to  the  surface  fluo¬ 
rescence  images. 

In  Vitro  Phantom  Studies 

The  results  for  the  in  vitro  phantom  experiments  are  shown  in  Fig¬ 
ures  6  (real-time  images)  and  7  (fast  subtracted  images)  for  different 
target  depths  (1-2  cm)  under  a  T:B  contrast  ratio  of  1:0.  The  true 
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Figure  5.  Fast  subtracted  images  of  fluorescence  intensity  obtained  as  2D  surface  contour  plots  acquired  from  slab  phantoms  (with 
uniform  background  scattering).  The  0.45-cm3  fluorescent  target  was  placed  at  different  locations  and  depths:  (A)  target  location  (x.yz)  — 
(2.0,  2.7,  1 .5),  and  (B)  target  location  (x,yz)  =  (2.0,  2.7,  2.0),  and  (C)  target  location  (x,yz)  -  (3.0,  2.2,  2.5).  The  black  hollow  circle  in  each 
subplot  is  the  true  target  location. 
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Figure  6.  Near  real-time  images  of  fluorescence  intensity  obtained  as  2D  surface  contour  plots  acquired  from  in  vitro  slab  phantoms 
(with  nonuniform  background  scattering).  The  0.45-cm3  fluorescent  target  was  located  at  a  depth  of  (A)  1 .0  cm  and  (B)  1 .5  cm  from  the 
imaging  surface.  The  black  hollow  circle  in  each  subplot  is  the  true  target  location. 


target  location  in  the  images  is  given  as  x,y,z  coordinates  where  “x”  is 
the  lateral  position,  “y”  is  the  height,  and  “z  is  the  depth  that  vary 
among  the  images.  Owing  to  heterogeneous  scattering  of  the  back¬ 
ground  phantom,  only  the  subtracted  images  were  capable  of  clearly 
differentiating  the  target  from  the  background  for  targets  deeper  than 
1 .0  cm.  These  studies  show  the  ability  of  the  handheld  device  to  per¬ 
form  fast  2D  surface  imaging  and  target  localization  within  a  non- 
uniform  scattering  tissue-mimicking  background. 

In  Vivo  Studies 

Figure  8  shows  the  fast  2D  subtracted  images  of  fluorescence  in¬ 
tensity  obtained  in  vivo  (from  a  healthy  human  subject  using  a  sim¬ 
ulated  target)  with  the  probe  in  the  flat  position  (Figure  8A)  and  in 
the  curved  position  (Figure  8 B).  These  subtracted  image  results  dem¬ 
onstrate  the  feasibility  of  fast  2D  surface  imaging  and  2D  target  lo¬ 
calization  in  a  clinical  environment.  The  real-time  (nonsubtracted) 
images  of  fluorescence  intensity  were  unable  to  differentiate  the  tar¬ 
get  from  the  heterogeneous  background,  and  hence,  only  the  fast  2D 
subtracted  images  are  shown  in  Figure  8. 


The  2D  subtracted  images  of  fluorescent  intensity  from  multiple 
simulated  targets  in  a  human  subject  are  shown  in  Figure  9.  The 
0.23-cm3  target  is  detected  in  the  center  of  the  image  and  the 
0.45-cm3  target  is  detected  toward  the  left  side  in  the  image,  which 
are  very  close  to  the  true  locations  of  these  targets.  This  study  dem¬ 
onstrates  the  potential  to  image  and  localize  multiple  fluorescent  tar¬ 
gets  (of  different  sizes)  within  human  breast  tissue. 

Discussion 

The  fluorescence  imaging  studies  described  here  demonstrate  for  the 
first  time  the  acquisition  of  fast  2D  surface  images  (in  <5  seconds)  of 
a  fluorescent  target  in  uniform  tissue  phantoms,  in  vitro,  and  in  vivo 
using  a  handheld-based  optical  imaging  device.  The  subtracted  im¬ 
ages  have  a  potential  to  clearly  differentiate  target(s)  from  the  back¬ 
ground  (under  various  experimental  conditions),  demonstrating  the 
potential  to  translate  the  technology  toward  on-site  breast  imaging  in 
a  clinical  environment.  Additional  experiments  were  performed  with 
the  target  located  at  greater  depths  in  the  tissue  phantoms,  but  the 
target  was  not  detected  at  a  depth  of  2.5  cm.  At  2.5  cm  deep,  the 
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Figure  7.  Fast  subtracted  images  of  fluorescence  intensity  obtained  as  2D  surface  contour  plots  acquired  from  in  vitro  slab  phantoms 
(with  nonuniform  background  scattering).  Images  were  collected  for  different  target  sizes  and  depths.  Images  (A)  to  (C)  contain  a  target 
size  of  0.45  cm3  at  depths  of  1 .0,  1 .5,  and  2.0  cm,  respectively.  Images  (D)  to  (F)  contain  a  target  size  of  0.23  cm3  at  depths  of  1 .0,  1 .5, 
and  2.0  cm,  respectively.  The  black  hollow  circle  in  each  subplot  is  the  true  target  location. 
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Figure  8.  Fast  subtracted  images  of  fluorescence  intensity  obtained  as  2D  surface  contour  plots,  acquired  in  vivo  from  a  human  subject 
using  a  spherical  fluorescent  target,  for  two  experimental  cases:  (A)  the  probe  was  in  the  flat  position  and  a  0.23-cm3  target  was  placed 
at  the  4-o'clock  position;  and  (B)  the  probe  was  in  the  curved  position  and  a  0.45-cm3  target  was  placed  at  the  8-o'clock  position.  The 
images  acquired  using  the  probe  in  the  curved  position  are  illustrated  as  projected  as  a  flat  2D  image  to  be  consistent  with  the  images 
presented  in  case  (A)  (i.e.,  using  the  probe  in  flat  position). 


detected  signal  from  the  target  is  close  to  the  noise  floor  and  hence 
not  differentiable  from  the  background.  A  multilocation  scanning  ap¬ 
proach  is  currently  developed  in  our  laboratory  for  differentiating 
deeply  located  or  small-volume  targets  from  homogenous  or  hetero¬ 
geneous  background  [11].  In  short,  this  approach  will  incorporate 
the  use  of  coregistered  images  obtained  at  multiple  locations  on 
the  tissue  surface,  such  that  the  targets  can  be  differentiated  from 
artifacts  as  well  as  the  background  [11],  When  comparing  Figures  4 
and  5,  it  can  be  seen  that  the  images  from  the  in  vitro  phantom  con¬ 
tain  more  noise  than  those  from  the  uniform  tissue  phantom.  This 
can  possibly  be  attributed  to  the  heterogeneous  distribution  of  scat¬ 
tering  properties  or  shifting  of  the  chicken  breast  as  the  target  is  re¬ 
moved  (which  can  cause  a  change  in  the  signal  distribution  when  the 
background  image  is  collected).  Experiments  were  also  performed 
using  the  in  vitro  phantoms  with  a  T:B  contrast  ratio  of  100:1.  How¬ 
ever,  the  noise  from  the  background  signal  dominated  the  image,  and 


a  target  was  not  detected  even  after  subtracting  the  excitation  back¬ 
ground  signal.  On  applying  our  multilocation  scanning  approach, 
the  targets  were  differentiable  under  imperfect  uptake  conditions 
(i.e.,  T:B  =  100:1)  [8].  In  addition  to  fast  2D  imaging,  the  handheld 
device  described  here  has  demonstrated  3D  tomography  of  fluores¬ 
cent  targets  with  tissue  phantoms  using  frequency-domain-based 
measurements  to  estimate  the  3D  location  and  volume  of  the  target 
within  the  tissue  [9].  Our  ongoing  efforts  will  involve  the  implemen¬ 
tation  of  fast  and  automated  coregistration  facilities  to  enable  precise 
2D  target  localization  (instantaneously)  as  well  as  3D  tomography 
studies  (in  vitro  as  well  as  in  vivo). 

Conclusions 

A  handheld-based  optical  imaging  device  has  been  developed  in  our 
Optical  Imaging  Laboratory  toward  in  vivo  clinical  studies  on  breast 
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Figure  9.  Fast  subtracted  image  of  fluorescence  intensity  obtained  as  2D  surface  contour  plot  acquired  in  vivo  from  a  human  subject 
using  two  spherical  fluorescent  targets  (0.23  and  0.45  cm3). 
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tissues.  The  device  has  been  tested  extensively  in  the  past  on  homo¬ 
geneous  slab  phantoms  (with  sample  results  shown  here).  The  device 
has  been  tested  for  CW-based  fluorescence  optical  imaging  in  vitro  as 
well  as  in  vivo.  The  fluorescence  studies  demonstrate  the  ability  of  the 
handheld  device  to  perform  fast  2D  imaging  and  also  detect  a  fluores¬ 
cent  target  within  a  heterogeneous  tissue-mimicking  background  as 
well  as  real  human  breast  tissue  (on  using  subtracted  images).  Future 
work  will  involve  fast  coregistered  imaging  of  human  breast  tissue  to 
enable  3D  tomography  in  human  subjects  using  this  novel  handheld- 
based  optical  device. 
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7  Near-infrared  optical  imaging  holds  a  promise  as  a  noninvasive  technology  toward  cancer 

8  diagnostics  and  other  tissue  imaging  applications.  In  recent  years,  hand-held  based  imagers  are  of 

9  great  interest  toward  the  clinical  translation  of  the  technology.  However  hand-held  imagers 

10  developed  to  date  are  typically  designed  to  obtain  surface  images  and  not  tomography  information 

11  due  to  lack  of  coregistration  facilities.  Herein,  a  recently  developed  hand-held  probe-based  optical 

12  imager  in  our  Optical  Imaging  Laboratory  has  been  implemented  with  novel  coregistration  facilities 

13  toward  real-time  and  tomographic  imaging  of  tissue  phantoms.  Continuous -wave 

14  fluorescence-enhanced  optical  imaging  studies  were  performed  using  an  intensified  charge  coupled 

15  device  camera  based  imaging  system  in  order  to  demonstrate  the  feasibility  of  automated 

16  coregistered  imaging  of  flat  phantom  surfaces,  using  a  flexible  probe  that  can  also  contour  to 

17  curvatures.  Three-dimensional  fluorescence  tomographic  reconstructions  were  also  demonstrated 

18  using  coregistered  frequency-domain  measurements  obtained  using  the  hand-held  based  optical 

19  imager.  It  was  also  observed  from  preliminary  studies  on  cubical  phantoms  that  multiple 

20  coregistered  scans  differentiated  deeper  targets  (~3  cm)  from  artifacts  that  were  not  feasible  from 

21  a  single  coregistered  scan,  demonstrating  the  possibility  of  improved  target  depth  detectability  in  the 

22  future.  ©  2009  American  Institute  of  Physics,  [doi:  10. 1063/1.327 1019] 


23  I.  INTRODUCTION 

24  Near-infrared  (NIR)  optical  imaging  is  a  promising  non- 

25  invasive  technology  with  an  indispensable  role  in  breast  can- 

26  cer  diagnostics,  among  many  other  applications.  In  recent 

27  years,  hand-held  based  optical  imaging  systems  have  been 

28  developed,  as  opposed  to  the  other  bulky  optical  imagers 

29  available,  toward  enhancing  the  clinical  translation  of  the 

30  technology. 1-19  The  hand-held  based  NIR  imaging  systems 

31  developed  to  date  are  typically  designed  to  obtain  surface 

32  images  and  not  tomography  information,  unless  they  are 

33  coupled  with  another  modality  toward  three-dimensional 

34  (3D)  tumor  localizations.  ~~  1  The  inability  to  perform  to- 

35  mography  is  due  to  limited  capabilities  to  coregister  an  im- 

36  age  with  its  correct  location  onto  a  given  tissue  geometry. 

37  Coregistration  is  essential  in  order  to  accurately  determine 

38  the  probe’s  position  on  the  3D  tissue  geometry  during  imag- 

39  ing  studies,  such  that  the  optical  measurements  can  be  used 

40  toward  3D  tomography  studies. 

41  Recently,  a  hand-held  based  optical  probe  has  been  de- 

42  signed  and  developed  in  our  Optical  Imaging  Laboratory 

43  (OIL),  with  the  following  unique  features:  (i)  flexibility  to 

44  image  different  tissue  curvatures  (0°-45°)  via  a  geometri- 

45  cally  adaptive  probe  head,  (ii)  ability  to  simultaneously  illu- 

46  minate  (at  6  point  locations)  and  collect  NIR  signals  (at  165 
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point  locations)  toward  rapid  data  acquisitions,  and  (iii)  port-  47 
ability  and  comfort  from  the  hand-held  design  with  maximal  48 
patient  comfort.  Preliminary  studies  demonstrated  the  feasi-  49 
bility  of  the  hand-held  imager  to  perform  3D  tomographic  50 
imaging  on  large  slab  phantoms  (650  cm3).4  In  these  experi-  51 
mental  studies,  a  single  probe  location  with  respect  to  the  52 
tissue  phantom  was  predetermined  manually  and  imple-  53 
mented  during  image  reconstructions.  However,  manual  54 
coregistration  of  the  probe  onto  the  tissue  phantom  may  not  55 
be  feasible  at  all  times,  especially  during  real-time  and  mul-  56 
tiple  location  scanning  on  curved  and/or  nonsymmetric  phan-  57 
toms  (e.g.,  breast  tissues).  Herein,  the  hand-held  optical  im-  58 
ager  is  improvised  and  implemented  with  an  innovative  59 
coregistration  technique  which  is  automated  toward  real-time  60 
coregistered  tracking  and  imaging.  Coregistered  images  were  61 
then  used  toward  3D  tomographic  imaging  of  a  tissue  phan-  62 
tom  from  a  single  random  scan.  63 

In  the  upcoming  sections,  the  materials  and  methods  64 
implemented  to  achieve  automated  (and  fast)  coregistered  65 
imaging  are  described.  Results  from  3D  coregistered  imag-  66 
ing  studies  on  tissue  phantoms  follow,  in  which  flat  probe  67 
face  configuration  is  implemented.  Quantitative  analyses  of  68 
these  results  are  then  performed  to  determine  the  accuracy  69 
and  precision  of  the  developed  coregistration  facilities  in  70 
conjunction  with  the  imager.  Additionally,  the  implications  71 
of  the  coregistration  method  (in  which  improved  target  depth  72 
detection  can  be  achieved)  are  addressed.  The  feasibility  of  73 
3D  fluorescence-enhanced  tomography  studies  using  coreg-  74 
istered  image(s)  is  also  demonstrated.  75 
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FIG.  1.  (Color  online)  (a)  Hand-held  probe-based  optical  imaging  system, 
(b)  Illumination-collection  fiber  layout  on  the  probe  head.  The  solid  big  red 
circles  are  the  illumination  fiber  locations  and  the  remaining  black  dots  are 
the  collection  fiber  locations. 

76  II.  MATERIALS  AND  METHODS 

77  A.  Hand-held  probe-based  optical  imager 

78  The  hand-held  probe-based  optical  imaging  system  (Fig. 

79  1)  is  developed  such  that  it  can  acquire  images  both  in  the 

80  continuous  wave  (CW)  and  frequency  domain  (FD)  mode.3'4 

81  A  5  X  10  cm2  probe  consisting  of  multiple  (6)  sources  and 

82  (165)  detectors  is  developed  and  used  along  with  a  laser 

83  diode  source  and  a  gain-modulated  intensified  charge 

84  coupled  device  (ICCD)  camera  based  detector. 

85  1.  Hand-held  optical  probe 

86  The  hand-held  probe  consisted  of  6  simultaneous  illumi- 

87  nating  and  165  simultaneous  collecting  points  (or  fibers), 

88  spaced  0.5  cm  apart  on  a  5  X  10  cm2  probe  head.  The  appro- 

89  priate  number  and  distribution  of  the  simultaneous  illuminat- 

90  ing  and  collecting  optical  fibers  was  chosen  such  that  the 

91  total  area  of  fluorescence  amplitude  was  maximized,  the  re- 

92  gions  with  very  weak  or  no  fluorescence  optical  signals  were 

93  minimized,  and  the  signal  strength  enhanced.  The  probe 

94  head  was  geometrically  adaptive  (segmented  three-piece  de- 

95  sign,  see  Fig.  1)  to  allow  imaging  of  any  given  tissue  curva- 

96  ture  (up  to  45°)  with  good  probe-tissue  contact  and  minimal 

97  patient  discomfort.  The  major  components  of  the  hand-held 

98  probe  are  the  probe  head  constituting  the  illuminating/ 

99  collecting  optical  fibers,  a  source  fiber  bundle,  and  a  collec- 

100  tion  fiber  bundle  (Romack  Inc.,  Williamsburg,  VA).  The 

101  hand-held  optical  probe  was  coupled  to  the  source  end  (laser 

102  diode)  and  detector  end  (ICCD  camera)  via  the  source  and 

103  collection  fiber  bundles,  respectively,  in  order  to  develop  a 

104  novel  hand-held  probe-based  optical  imager.4 

105  2.  Imaging  system 

106  Laser  light  (at  785  nm  wavelength)  is  launched  onto  the 

107  tissue  phantom  using  the  hand-held  probe  via  a  source  fiber 

108  bundle  (consisting  of  six  fibers)  coupled  to  the  laser  source 

109  (on  one  end)  and  the  probe  head  (on  the  other  end).  The 

110  probe  collects  the  optical  signals  from  the  tissue  surface  via 

111  the  detector  fiber  bundle  (consisting  of  165  fibers)  and  is 

112  then  imaged  by  the  ICCD  camera.  Initially,  the  modulated 

113  laser  light  from  the  laser  diode  illuminated  the  tissue  phan- 
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FIG.  2.  Schematic  of  the  frequency-domain  optical  imaging  instrumenta¬ 
tion,  using  a  flexible  hand-held  optical  probe. 


tom  surface  via  simultaneous  illuminating  fiber(s)  of  the  114 
hand-held  probe  (<5  mW  at  each  illumination  point).  The  115 
NIR  signal  emitted  from  the  tissue  phantom  surface  was  ac-  116 
quired  by  collection  fibers  of  the  hand-held  probe  and  im-  117 
aged  using  a  16-bit,  1024X1024  pixel  CCD  camera  (PI-  118 
SCX,  Roper  Scientific)  that  is  optically  coupled  with  an  119 
image  intensifier  (FS9910,  ITT  Night  Vision).  A  focusing  120 
lens  (50  mm,  Nikon  Inc.)  for  image  focus  and  interference  121 
filters  for  excitation  light  rejection  (improved  upon  using  122 
two  filters)  were  coupled  to  the  ICCD  camera  via  a  lens  123 
assembly.  124 

The  imaging  system  was  operated  in  the  homodyne  125 
mode,  meaning  that  both  the  source  and  detector  ends  are  126 
modulated  at  the  same  frequency  (here  100  MHz)  (Fig.  2).  127 
The  two  frequency  synthesizers  generating  the  radio  fre-  128 
quency  (rf)  signal  at  the  source  and  detector  end  were  phase  129 
locked.  By  introducing  phase  delays  varying  from  0  to  2w  130 
(here  32  delays)  between  the  two  frequency  synthesizers,  131 
steady-state  phase-sensitive  intensity  images  were  acquired.4  132 
Fast  Fourier  Transforms  were  used  to  extract  the  amplitude  133 
and  phase  shift  information  from  the  acquired  steady-state  134 
images.  The  extracted  amplitude  and  phase  shift  data  were  135 
then  used  toward  tomography  studies.  For  all  experimental  136 
cases,  a  subtraction-based  postprocessing  technique  was  em-  137 
ployed  for  eliminating  excitation  leakage  and  all  the  mea-  138 
surements  were  referenced  in  order  to  account  for  the  instru-  139 
ment  effects  (details  described  in  Sec.  II  D).  140 

The  hand-held  imager  is  designed  to  perform  simulta-  141 
neous  multiple  point  illumination  and  simultaneous  multiple  142 
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TABLE  I.  Advantages  and  disadvantages  of  different  tracking  methods. 


Tracking  method 

Advantage 

Disadvantage 

Manual 

•  Simple,  straightforward 

•  Unlike  electromagnetic  (EM)  trackers,  not  affected  by  magnetic 
fields 

•  Linear  actuators  make  for  easy  one-dimensional  tracking  with 

Limited  to  simple/symmetric  geometries 

Mechanical 

high  precision 

•  Use  of  multiple  actuators  enables  multidimensional  tracking 
•  Unlike  EM  trackers,  not  affected  by  magnetic  fields 

Limited  mobility 

Inertial 

•  Recent  technological  advances  have  facilitated  miniaturization 
•  Unlike  EM  trackers,  not  affected  by  magnetic  fields 

Poor  measurement  accuracy  over  time 

Cannot  be  in  the  presence  of  metal  objects  or  even 

EM 

•  Can  be  obstructed  by  large  objects  and  still  be  tracked 

•  No  direct  connection  between  transmitter  and  receiver  is 

small  magnetic  fields 

Optical 

required 

•  Unlike  EM  trackers,  not  affected  by  magnetic  fields 

Require  a  direct  line  of  sight  of  tracked  objects 

Acoustic 

•  Unlike  EM  trackers,  not  affected  by  magnetic  fields 

Require  a  direct  line  of  sight  of  tracked  objects 

148  point  detection,  in  order  to  enhance  the  total  data  acquisition 

144  rates.  In  the  current  studies,  the  automated  coregistered  im- 

145  aging  approach  and  3D  tomographic  imaging  were  demon- 

146  strated  by  operating  the  imaging  system  in  the  CW-  and  FD- 

147  modes,  respectively. 

148  B.  Automated  coregistered  imaging  approach 

149  Coregistered  imaging  is  the  process  of  lining  up  at  least 

150  two  images  (planar  or  volumetric)  within  the  same  coordi- 

151  nate  space.  Two  types  of  coregistration  techniques  that  exist 

152  include  intermodality  and  intramodality.  Intermodality  coreg- 

153  istration  combines  images  of  different  modalities  (e.g.,  CT/ 

154  MRI,  SPECT/MRI,  optical/MRI,  etc.),20  2_  whereas  intramo- 

155  dality  coregistration  combines  images  from  the  same 

156  modality  (e.g.,  3D  ultrasound  imaging)."’"4  Researchers  per- 

157  forming  intermodality  or  intramodality  based  coregistration 

158  employ  tracking  systems  (i.e.,  position  sensors  and/or 

159  intemal/external  fiducial  markers)  for  3D  image  coregistra- 

160  tion  and  reconstruction  in  the  field  of  biomedical  imaging  (a 

161  few  example  citations  listed).2538 

162  In  the  current  work,  an  intramodality  coregistration 

163  method  similar  to  3D  ultrasound  imaging  is  developed,  such 

164  that  coregistered  3D  surface  images  from  two-dimensional 

165  (2D)  surface  data  can  be  obtained.  These  3D  surface  images 

166  will  in  turn  be  used  toward  3D  tomographic  analysis  (as 

167  described  in  Sec.  II  E).  In  order  to  perform  coregistered  im- 

168  aging,  tracking  the  imaging  probe’s  (or  device’s)  position 

169  and  orientation  with  respect  to  the  tissue/phantom  surface 

170  being  imaged  is  essential.  This  tracked  3D  positional  infor- 

171  mation  is  then  used  to  accurately  position  the  acquired  opti- 

172  cal  images  onto  the  tissue  geometry.  There  are  several  differ- 

173  ent  tracking  methods  (e.g.,  manual,  mechanical,  inertial, 

174  electromagnetic,  optical,  and  acoustic)  that  enable  coregistra- 

1 75  tion  to  be  performed  by  allowing  the  position  and  orientation 

176  of  an  object  to  be  known  (see  Table  I  for  their  advantages 

177  and  disadvantages).  For  our  optical  imaging  study  using  the 

178  hand-held  optical  probe,  an  acoustic  tracking  method  is  em- 

AQ:  179  ployed  for  the  following  reasons:  (i)  there  is  no  interference 
#1  180  between  optical  signals  from  the  optical  imager  and  ultra- 

181  sonic  signals  from  the  acoustic  tracker  and  it  is  (ii)  impervi¬ 


ous  to  metallic  objects  and  magnetic  fields  (which  encom-  182 
pass  the  environment  surrounding  the  optical  imaging  183 
system)  as  observed  in  electromagnetic  trackers.  184 

A  3D  acoustic-based  tracker  from  Logitech  Inc.  (Fre-  185 
mont,  CA)  was  employed  along  with  the  hand-held  probe-  186 
based  imaging  system.  The  tracking  system  (or  tracker)  con-  187 
sists  of  a  transmitter  (installed  ~2  ft  above  the  hand-held  188 
probe  and  in  a  direct  line  of  sight  with  the  same),  receiver  189 
(attached  to  hand-held  probe),  and  a  processing  unit.  The  190 
receiver  is  lightweight  (<15  g)  and  portable,  which  has  a  191 
minimal  impact  on  the  probe’s  inherent  mobility;  and  the  192 
transmitter  utilizes  ultrasound  frequencies  (23  kHz),  which  193 
will  not  interfere  with  the  optical  imaging  system.  The  track-  194 
ing  system  can  determine  the  3D  location  of  the  probe  (or  195 
receiver)  with  respect  to  the  transmitter  in  real-time  within  a  196 
5  ft  radius  and  a  100°  spherical  cone  (Fig.  1).  The  related  197 
tracking  software  (processing  unit)  was  interfaced  to  a  com-  198 
puter  via  MATLAB  such  that  a  tracked  object’s  location  is  199 
obtained  with  six  degrees  of  freedom  (x,  y,  z,  pitch,  yaw,  and  200 
roll),  determining  both  the  object’s  position  and  orientation.  201 
Coregistered  imaging  of  tissue/phantoms  is  implemented  as  a  202 
three-stage  process  (see  Fig.  3).  203 

Stage  1.  The  first  stage  (probe  tracking)  tracks  the  hand-  204 
held  probe’s  location  with  respect  to  a  discretized  phantom  205 
mesh  via  the  determination  of  the  spatial  3D  probe  location  206 
(steps  1-4  in  Fig.  3).  The  ultrasound-based  motion  tracker  207 
provides  six  degrees  positional  information  of  a  single  point  208 
on  the  probe,  in  real-time  (step  1  of  Fig.  3).  The  software  209 
used  to  acquire  data  from  the  tracker  was  developed  in  the  210 
MATLAB  environment.  Here,  a  16  X  1  vector  of  binary  data  in  211 
16  byte  format  was  obtained  from  the  tracker  when  prompted  212 
via  a  direct  RS-232  connection  to  the  host  computer.  These  213 
binary  data  were  further  concatenated  into  a  single  string  and  214 
converted  to  decimal  format  by  applying  the  “bin2dec()”  215 
MATLAB  function.  The  resulting  set  of  decimal  values  corre-  216 
spond  to  the  real  time  x,  y,  z,  pitch,  yaw,  and  roll  of  the  217 
receiver  The  MATLAB  code  was  further  implemented  into  a  218 
LAB  VIEW  program  (developed  in-house)  in  order  to  automate  21 9 
the  process  of  data  acquisition  such  that  as  the  tracker  220 
changes  location,  the  coordinates  and  orientation  change  ac-  221 
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FIG.  3.  (Color  online)  Flowchart  of  the  coregistered  imaging  process,  implemented  as  automated  coregistration  software  during  optical  imaging  studies. 


222  cordingly,  with  minimal  lag  in  real  time.  Initially,  the  loca- 

223  tion  data  of  a  single  reference  point  on  the  probe  (here  the 

224  left  bottom  comer  detector  of  the  probe  is  chosen)  is  ac- 

225  quired  in  binary  format  from  the  processing  unit  (of  motion 

226  tracker)  and  converted  to  decimal  format  using  the  devel- 

227  oped  MATLAB  code. 

228  Tracking  a  single  point  in  3D  space  is  further  translated 

229  to  tracking  all  the  source  and  detector  points  (spaced  0.5  cm 

230  apart)  on  the  flat  probe  head  (step  2  of  Fig.  3).  The  probe 

231  head  is  built  as  three-piece  plates  to  allow  it  to  flex  along  the 

232  interfaces  of  the  plates,  in  order  to  image  tissue  curvatures. 

233  When  the  probe  head  had  to  be  used  in  its  flex  (or  curved) 

234  position,  the  source  and  detector  locations  can  be  determined 

235  from  the  angle  of  curvature  of  the  two  outer  plates.  The  angle 

236  of  curvature  is  determined  independently  for  each  outer  plate 

237  using  an  angle  indicator  affixed  to  the  probe.  Apart  from 

238  tracking  the  source-detector  points  of  the  probe  head,  a  3D 

239  discretized  phantom  or  tissue  geometry  is  simulated  (step  3 

240  of  Fig.  3). 

241  The  phantom  mesh  is  a  set  of  discretized  data  represent- 

242  ing  the  phantom  volume,  which  can  be  acquired  using  mesh- 

243  ing  software  (GAMBIT,  ANSYS  Inc.,  Canonsburg,  PA)  or 

244  generated  within  the  MATLAB  programming  environment.  For 

245  experimental  studies,  cubical  phantom  meshes  of  appropriate 

246  volumes  were  generated  in  GAMBIT  and  utilized  for  coregis- 

247  tration  studies.  For  complex  geometries  (e.g.,  in  vivo  cases), 

248  a  3D  laser  scanner  may  be  utilized  in  order  to  obtain  a  simu- 

249  lated  3D  phantom/tissue  geometry,  which  can  in  turn  be  dis- 

250  cretized  using  a  meshing  software. 

251  The  tracked  source-detector  points  are  globally  posi- 

252  tioned  with  respect  to  the  3D  discretized  phantom  (step  4  of 

253  Fig.  3)  and  not  yet  coregistered.  The  overall  probe  tracking  is 


accomplished  by  utilizing  M ATL AB/L AB VIEW  code  developed  254 
in-house  for  the  acoustic  tracker.  For  a  preuploaded  dis-  255 
cretized  phantom  mesh  onto  the  coregistration  software,  the  256 
average  time  to  acquire  probe  tracking  for  each  new  probe  257 
location  is  almost  in  real  time  (<1  s).  258 

Stage  2.  The  second  stage  (image  acquisition)  involves  259 
acquisition  of  raw  optical  signals  (i.e.,  steady-state  intensity  260 
signals)  using  the  hand-held  optical  imager  (step  5  of  Fig.  3).  261 
These  data  are  postprocessed,  using  in-house  developed  MAT-  262 
LAB  codes,  in  order  to  obtain  meaningful  optical  measure-  263 
ments  (i.e.,  amplitude  and  phase-shift  for  FD-based  measure-  264 
ments  and  intensity  for  CW-based  measurements)  at  their  265 
respective  point  locations  on  the  imaged  plane  (step  6  of  Fig.  266 
3).  For  each  change  in  location  of  the  probe,  a  2D  surface  267 
image  (as  contour  plot)  of  optical  signals  (generated  in  MAT-  268 
lab)  is  generated  from  the  acquired  (FD  or  CW)  optical  269 
measurements  (step  7  of  Fig.  3). 4  The  images  can  be  from  270 
fluorescence-enhanced  or  nonfluorescence  (diffuse)  optical  271 
imaging  studies.  The  location  of  each  image  is  simulta-  272 
neously  tracked  as  described  in  stage  1,  such  that  a  coregis-  273 
tered  image  could  be  generated  in  the  subsequent  stage.  The  274 
average  time  to  acquire  fluorescence  optical  measurements  275 
and  display  the  data  as  2D  surface  images  (contour  plots)  is  276 
~2  s  (i.e.,  0.2  s  exposure  time  for  each  of  the  five  repeated  277 
measurements,  and  ~1  s  for  data  postprocessing  to  obtain  278 
2D  surface  contour  plots).  279 

Stage  3.  The  third  stage  displays  a  coregistered  image  280 
via  tracking/coregistration  interfacing  software  developed  in  281 
MATLAB/LABVIEW  (developed  in-house).  The  2D  surface  282 
contour  plot  of  optical  measurements  is  coregistered  onto  the  283 
3D  discretized  phantom  at  the  probe  location  using  the  posi-  284 
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tional  information  of  the  entire  probe  head  (i.e.,  all  source 

286  and  detector  point  locations)  during  each  scan.  Coregistra- 

287  tion  is  achieved  by  determining  every  source-detector’s  po- 

288  sitional  information  onto  the  appropriate  x-y-z  coordinates  of 

289  the  3D  discretized  phantom  (step  8  of  Fig.  3).  This  is  fol- 

290  lowed  by  correlating  the  obtained  fluorescence  measure- 

291  ments  with  respect  to  the  coregistered  positional  information 

292  on  the  phantom,  which  represents  the  actual  imaged  area  on 

293  the  3D  phantom  (step  9  of  Fig.  3).  The  average  time  for 

294  obtaining  a  coregistered  image  for  alOXlOXlO  cm3  cubi- 

295  cal  phantom  (simulated  as  a  3D  discretized  volume  mesh) 

296  was  —25  s.  When  only  a  3D  surface  mesh  was  employed 

297  (for  a  different  study),  the  average  time  to  obtain  a  coregis- 

298  tered  image  dropped  significantly  (—25%  of  the  above  time). 

299  The  coregistered  imaging  process  is  automated  for  rapid 

300  data  acquisitions,  via  the  integration  of  image  acquisition 

301  software  into  the  tracking/coregistration  software.  Here  auto- 

302  mation  is  defined  by  allowing  the  entire  data  acquisition  of 

303  coregistered  images  to  be  carried  out  with  least  operator  in- 

304  volvement,  such  that  the  displayed  optical  contour  plots  are 

305  in  near  real  time  (with  a  few  seconds  delay). 

306  The  main  features  of  the  developed  coregistration  soft- 

307  ware  are  its  ability  to  (i)  upload  any  set  of  face  and  vertex 

308  data  corresponding  to  a  3D  phantom  mesh,  (ii)  adjust  the 

309  on-screen  position/orientation  of  a  phantom  mesh  to  match 

310  its  real-time  location,  (iii)  employ  simulated  or  real-time  im- 

311  ages  during  coregistration,  (iv)  autonormalize  the  contour 

312  maps  of  the  acquired  images  from  different  locations,  with 

313  respect  to  the  maximum  value  of  the  optical  signal  (here, 

314  optical  intensity),  (v)  retain/erase  an  image  from  a  previous 

315  scan(s),  (vi)  acquire  and  display  real-time  probe  location/ 

316  orientation,  (vii)  adjust  the  on-screen  angle  of  the  probe’s 

317  outer  plates  to  match  its  real-time  angles,  and  (viii)  save  all 

318  displayed  information  into  a  single  MATLAB  file  for  postpro- 

319  cessing  and  analysis.  The  current  version  of  the  coregistra- 

320  tion  software  is  designed  to  work  with  phantoms  with  known 

321  position/orientation  and  not  moving  phantoms  that  need  to 

322  be  tracked,  since  no  tracker  is  placed  on  the  phantom  as  with 

323  the  hand-held  probe.  In  the  future,  this  can  be  remedied  by 

324  adding  tracking  abilities  to  the  phantom  (or  subject)  being 

325  imaged,  thereby  allowing  location  and  orientation  of  the 

326  phantom/tissue  to  be  automatically  known  and  updated  in 

327  real  time. 

328  C.  Experimental  Studies 

329  Fluorescence-enhanced  experimental  imaging  studies 

330  were  performed  to  demonstrate  the  feasibility  of  the  auto- 

331  mated  (and  fast)  coregistered  imaging  using  a  hand-held 

332  probe-based  optical  imager.  Exogenous  fluorescence  contrast 

333  agent  [indocyanine  green  (ICG)]  was  used  to  enhance  the 

334  optical  absorption  contrast  in  tumorlike  target(s)  to  simulate 

335  a  clinical  environment,  wherein  real-time  coregistered  opti- 

336  cal  imaging  will  be  performed. 

337  Successful  implementation  of  the  coregistered  tracking 

338  method  would  be  indicated  by  the  ability  to  track  the  actual 

339  location  of  the  target  even  upon  moving  the  probe’s  location 

340  with  respect  to  the  phantom  surface.  Initially,  cubical  phan- 

341  toms  were  chosen  to  demonstrate  one -dimensional,  2D,  and 

342  3D  coregistered  imaging,  since  the  cubical  geometry  is 


simple  and  the  probe  face  can  be  used  in  the  flat  position  242 
(i.e.,  angle  of  curvature,  0=  0°).  Herein,  only  the  3D  auto-  344 
mated  coregistered  imaging  results  are  presented  for  the  ex-  345 
perimental  case  employing  the  probe  in  its  flat  position  (for  346 
cubical  phantoms).  The  effectiveness  of  automating  the  fast  347 
coregistration  method  was  assessed  by  evaluating  the  accu-  348 
racy  and  precision  of  the  target  location.  The  accuracy  of  the  349 
coregistration  method  is  determined  by  calculating  the  per-  350 
centage  error  between  the  true  target  location  and  the  experi-  351 
mental  target  location  (i.e.,  the  highest  detected  intensity  cor-  352 
responding  to  the  centroid  of  the  target)  for  all  scans  on  each  353 
phantom  face.  The  precision  of  the  coregistration  method  is  354 
determined  by  calculating  the  standard  deviation  of  the  ex-  355 
perimental  target  location  for  each  new  scan  (which  is  an  356 
average  of  five  repeated  images)  obtained  at  varying  probe  357 


locations.  358 

D.  3D  coregistration  studies  359 

1.  Coregistration  studies  using  a  flat  probe  on  360 

cubical  phantoms  361 


Cubical  phantom  studies  were  performed  (using  a  10  362 
X  10  X  10  cm3  phantom)  in  order  to  evaluate  the  ability  to  363 
track  a  target’s  location  in  three  dimensions  (about  an  entire  364 
phantom  volume)  while  the  probe  face  was  in  the  flat  posi-  365 
tion.  The  phantom  was  filled  with  850  ml  1%  liposyn  solu-  366  AQ: 
tion  and  a  0.45  cm3  spherical  target  (filled  with  1%  liposyn  367  #3 
and  1  /xM  ICG)  was  submerged  1.5  cm  deep  from  both  the  368 
x-z  and  y-z  planes  of  the  phantom  (centroid  location  is  [1.5,  369 
1.5,  2.8]  cm).  370 

The  probe  was  placed  flat  on  the  surface  of  a  single  face  371 
of  the  cubical  phantom  and  CW-based  fluorescence  intensity  372 
measurements  were  acquired  on  the  same  face  at  six  differ-  373 
ent  locations  moving  in  the  vertical  “z”  direction  ([x,y,z]  374 
=  [0,0,0;  0,0, 0.5;  0,0, 1.0;  0,0, 1.5;  0,0, 2.0;  0,0,2.5]c3fl$. 
Prior  to  coregistering,  the  fluorescence  intensity  data  were  376 
postprocessed  to  remove  the  background  noise  arising  from  377 
excitation  leakage.4  This  was  accomplished  by  subtracting  378 
the  intensity  plots  of  a  nonfluorescing  homogeneous  phan-  379 
tom  (at  the  same  probe  location)  from  the  fluorescence  in-  380 
tensity  data  acquired  for  the  actual  experimental  case  [here,  381 
containing  fluorescence  target(s)].  The  final  subtracted  fluo-  382 
rescence  intensity  data  obtained  at  all  probe  locations  were  383 
normalized  with  respect  to  the  maximum  detected  intensity  384 
up  to  that  scan,  such  that  all  the  2D  surface  contour  plots  385 
were  on  the  same  scale.  386 

The  subtracted  and  normalized  images  were  coregistered  387 
fast  (in  near  real  time)  onto  a  3D  discretized  phantom  surface  388 
mesh  for  each  of  the  six  measurements  using  the  developed  389 
coregistration  software.  After  each  set  of  measurements  was  390 
completed  on  a  single  face  of  the  phantom,  the  phantom  was  391 
rotated  90°  in  a  counter-clockwise  direction  and  another  set  392 
of  measurements  (now  on  a  second  face)  was  acquired  at  a  393 
similar  location  as  the  first  face,  with  0.5  cm  increments  in  394 
the  probe  location  along  the  z-axis.  This  process  was  re-  395 
peated  such  that  four  measurement  sets  resulted  from  the  396 
four  faces  of  the  cubical  phantom.  The  fluorescence  intensity  397 
data  were  plotted  as  2D  surface  contour  plots,  which  were  398 
coregistered  directly  onto  a  3D  discretized  phantom  mesh  399 
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FIG.  4.  (Color  online)  Coregistered  surface  contour  images  of  fluorescence  intensity  (subtracted  and  normalized)  obtained  from  face  1  of  a  10X10 
X  10  cm3  cubical  phantom  containing  a  0.45  cm3  target  located  at  [1.5,  1.5,  2.8]  cm.  The  white  dotted  line  corresponds  to  the  hand-held  probe  location  on 
face  1  of  the  cubical  phantom  and  the  white  circle  corresponds  to  the  true  target  location  in  2D.  The  probe  was  moved  along  the  height  of  the  phantom,  with 
its  location  varying  in  the  increments  of  0.5  cm,  starting  from  z=0  cm  up  to  2.5  cm  [(a)— (f)]. 


400  (generated  in  GAMBIT  and  uploaded  into  MATLAB).  In  the 

401  cubical  phantom  studies,  the  phantom  was  rotated  instead  of 

402  the  hand-held  probe  in  order  to  acquire  images  from  all 

403  faces,  since  the  tension  in  the  fiber  bundle  did  not  allow  the 

404  probe’s  rotation  by  90°  such  that  all  sides  of  the  phantom  are 

405  imaged.  Instead,  the  position/orientation  of  the  symmetric 

406  phantom  was  manually  acquired  and  inputted  into  the  coreg- 

407  istration  software  for  the  cubical  phantom  studies. 

408  E.  Tomography  studies  using  coregistered 

409  measurements 

410  The  advantage  of  implementing  a  tracking  system  is  the 

411  ability  to  use  the  obtained  fast  coregistered  measurements 

412  toward  3D  tomographic  studies  using  a  hand-held  based  op- 

413  tical  imager.  Frequency-domain  based  fluorescence  measure- 

414  ments  (in  terms  of  ac  and  phase  shift)  were  obtained  at  a 

415  single  location  of  the  probe  on  the  phantom  and  the  measure- 

416  ments  were  coregistered  using  the  above  described  technique 

417  (Sec.  II  B).  A  single  0.45  cm3  fluorescent  target  filled  with 

418  1%  liposyn  and  1  /rM  ICG  was  located  at  [18.5,14.6,  6.5] 

419  cm  in  a  20X20X20  cm3  phantom  filled  with  6000  cm3  of 

420  1%  liposyn  solution  (with  fluorescence  optical  contrast  ratio 

421  of  1:0  and  at  1.5  cm  deep  from  x  =  20  cm  plane).  3D  image 

422  reconstructions  were  then  performed  using  the  approximate 

423  extended  Kalman  filter  (AEKF)  based  inverse  algorithm  (see 

424  Appendix),  which  recursively  minimizes  the  variance  of  pa- 

425  rameter  error  (i.e.,  error  in  fluorescence  absorption  coeffi- 

426  cient  yuaxf  for  this  study)  given  the  estimation  of  measure- 

427  ment  error  covariance  R,  model  error  covariance  Q,  and 

428  parameter  error  covariance  R  The  model  error  covariance  Q 

429  was  empirically  chosen  to  be  equal  to  1/4  of  the  measure- 

430  ment  error  covariance  R,  which  was  estimated  from  the  vari- 

431  ances  of  the  means  of  five  repeated  experimental 

432  measurements4'39  at  each  probe  location. 

433  Reconstructions  were  assumed  to  have  converged  when 

434  the  root  mean  square  output  error  was  less  than  1%,  or  the 


total  number  of  iterations  exceeded  50.  The  absorption  coef-  4^ 
ficient  of  the  fluorophores  (/zax(-)  was  the  reconstruction  pa-  436 
rameter,  with  an  initial  of  /raxt  =  0.003  cm-1,  as  assumed  for  437 
the  entire  phantom.  The  reconstructed  3D  target  centroid,  438 
volume  and  fluorescence  absorption  coefficient  was  quanti-  439 
tatively  estimated  from  introducing  a  cutoff  value  in  the  re-  440 
constructed  /x.lxf  (as  the  first  break  point  in  the  histogram  of  441 
the  fluorescence  absorption  coefficient)  in  order  to  differen-  442 
tiate  the  possible  target(s)  from  the  background.  Further  de-  443 
tails  of  3D  tomography  studies  performed  using  the  hand-  444 
held  optical  imager  can  be  found  elsewhere.4  445 


F.  Coregistered  Imaging  toward  Improved  target  446 
depth  detection  447 

In  this  study,  CW-based  fluorescence  imaging  studies  448 
were  performed  on  a  cubical  phantom,  containing  a  single  449 
fluorescing  target  (with  1%  liposyn  and  1  /iM  ICG)  under  450 
perfect  uptake  conditions  (i.e.,  no  fluorescence  in  the  back-  451 
ground).  The  target  was  located  3  cm  deep  from  the  phantom  452 
face  3  and  its  centroid  location  was  [3.0,  2.5,  2.8]  cm.  The  453 
coregistered  images  acquired  from  multiple  locations  on  454 
each  cubical  phantom  surface  (as  described  in  the  above  sec-  455 
tions)  were  superimposed  and  summated  in  order  to  obtain  a  456 
3D  coregistered  image  of  the  entire  cubical  phantom.  When  a  457 
summation  of  fluorescence  intensity  is  performed,  trends  in  458 
intensity  patterns  for  each  individual  scan  that  would  other-  459 
wise  appear  as  random  noise  may  possibly  add  up  to  gener-  460 
ate  an  image  where  the  highest  intensity  corresponds  to  the  461 
sum  of  weak  signals  (associated  with  the  true  target  loca-  462 
tion).  These  weak  signals  from  the  target  location  may  oth-  463 
erwise  not  be  detectable  or  differentiable  from  background  464 
noise  (or  artifacts)  when  obtained  from  an  individual  (or  465 
single)  scan.  The  effectiveness  of  using  the  summated  fluo-  466 
rescence  intensity  data  from  multiple  scans  over  the  fluores-  467 
cence  intensity  obtained  from  a  single  scan  toward  improved  468 
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FIG.  5.  (Color  online)  (Enhanced  online)  The  coregistered  images  (as  2D 
surface  contour  plots  of  subtracted  and  normalized  fluorescence  intensity 
data)  of  the  10X10X10  cm3  cubical  phantom  from  multiple  scans  (along 
the  z-axis)  performed  on  the  four  faces  of  the  phantom  (as  shown).  The 
phantom  contained  a  0.45  cm3  target  at  1:0  fluorescence  and  optical  con¬ 
trast  at  [1.5,  1.5,  2.8]  cm.  Individual  coregistered  images  from  each  face  (as 
shown  for  face  1  in  Fig.  4)  were  combined  to  generate  the  current  3D  plot. 
The  figure  also  represents  single  frame  excerpts  from  real-time  coregistered 
imaging  of  the  cubical  phantom,  with  images  retained  from  previous  scans, 
(media  1.09  MB,  enhanced  online). 


4®9  target  depth  detection  is  assessed  from  2D  surface  contour 

470  plots. 

471  III.  RESULTS  AND  DISCUSSION 


Cubical  Phantom  Study:  Percentage  Errors 


15.00 

13.00 
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Cubical  PhantomStudy:  Standard  Deviations 
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FIG.  6.  (a)  The  percentage  error  between  the  true  target  location  and  experi¬ 
mental  target  location  for  scans  1-6  is  shown  for  phantom  faces  1  and  4. 
The  large  degree  of  variability  between  scans  can  be  attributed  to  the  un¬ 
tracked  changes  in  phantom  position  and  orientation,  (b)  The  standard  de¬ 
viation  of  five  repeated  images  for  each  scanned  location  shown  for  phan¬ 
tom  faces  1  and  4.  The  large  degree  of  variability  between  scans  can  be 
attributed  to  instrument  error  from  the  optical  imaging  system  due  to  probe 
movement  against  the  phantom  surface  during  the  period  in  which  the  five 
repeated  images  were  being  acquired. 


472  A.  3D  coregistration  studies  using  the  flat  probe  on 

473  cubical  phantoms 

474  Figure  4  shows  all  six  coregistered  2D  surface  contour 

475  images  obtained  from  face  1  of  the  10  X  10  X  10  cm3  cubical 

476  phantom.  Figure  5  shows  fused  coregistered  2D  surface  con- 

477  tour  images  obtained  on  each  face  of  the  cubical  phantom.  A 

478  multimedia  file  is  also  provided  in  order  to  demonstrate  au- 

479  tomated  (fast)  imaging  capabilities  of  the  imaging  system.  In 

480  the  multimedia  file,  the  previous  scans  are  retained  as  new 

481  scans  are  performed  at  different  faces  and  locations  of  the 

482  probe  with  respect  to  the  cubical  phantom.  The  target  was 

483  located  1.5  cm  deep  with  respect  to  phantom  faces  1  and  4, 

484  and  was  detectable  from  both  these  faces  and  not  faces  2  and 

485  3,  since  it  was  very  deep  >8  cm  with  respect  to  these  faces. 

486  From  Figs.  4  and  5,  it  can  be  seen  that  the  target  was 

487  detected  closer  to  the  true  location,  although  there  was  a  high 

488  degree  of  variability  in  target  detectability  between  scans. 

489  Evaluation  of  the  automation  process  was  determined  by  per- 

490  forming  a  percentage  error  analysis  (which  denotes  accuracy 

491  of  the  coregistration  method)  between  the  true  and  experi- 

492  mental  target  locations.  The  experimental  target  location  was 

493  determined  by  locating  the  point  of  highest  detected  intensity 

494  (corresponding  to  the  center  of  the  spherical  target)  for  each 

495  of  the  six  scans  taken  on  phantom  faces  1  and  4.  Figure  6(a) 

496  shows  a  graph  of  the  percentage  errors  for  scans  1-6  on 

497  phantom  faces  1  and  4.  It  can  be  seen  from  these  bar  plots 

498  [Fig.  6(a)]  that  the  percentage  errors  vary  between  scans  for 


both  faces.  The  high  degree  of  variability  between  scans  in-  499 
dicates  the  occurrence  of  misaligned  coregistrations  due  to  500 
the  manual  (and  possibly  inaccurate)  tracking  of  the  phan-  501 
tom’s  position/orientation  as  it  was  rotated  and  held  between  502 
multiple  scans.  503 

In  the  future,  a  second  motion  tracking  device  is  in-  504 
stalled  onto  the  phantom  geometry,  in  order  to  synchronously  505 
track  both  the  phantom  (or  tissue  geometry)  and  the  hand-  506 
held  optical  probe  during  imaging  studies.  This  will  improve  507 
the  accuracy  of  coregistered  probe  location,  which  in  turn  508 
can  impact  the  precision  of  target  localization  and  tomogra-  509 
phic  analysis.  From  a  clinical  perspective,  the  inherent  mo-  510 
tion  during  breast  imaging  can  be  recorded  and  accounted  511 
for,  by  placing  this  second  motion  tracker  at  a  chosen  point  512 
of  reference  on  the  participating  subject.  513 

When  an  individual  scan  is  acquired  for  one  phantom  514 
face,  the  final  image  is  an  average  of  five  repeated  images  515 
taken  from  the  same  phantom  face  in  ~1  s.  The  standard  516 
deviation  (which  denotes  precision  of  the  coregistration  517 
method)  of  the  highest  detected  intensity  between  repeated  518 
images  is  an  indicator  of  the  extent  to  which  misaligned  519 
coregistrations  may  have  occurred  due  to  instrument  errors  520 
from  the  optical  imaging  system  or  movement  of  the  probe  521 
while  it  was  being  held.  Figure  6(b)  provides  a  bar  plot  of  the  522 
standard  deviation  for  each  of  the  six  scanned  locations  on  523 
phantom  faces  1  and  4.  It  can  be  seen  from  Fig.  6(b)  that  524 
there  is  variability  in  the  standard  deviation  between  re-  525 
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FIG.  7.  (Color  online)  A  3D  isosurface  plot  of  the  reconstructed  tissue 
phantom  showing  the  reconstructed  and  the  true  target  location,  for  an  ex¬ 
perimental  case  with  1:0  fluorescence  optical  contrast  of  a  single  0.45  cm3 
target  located  1.5  cm  deep  (from  the  x=20  cm  plane). 


depth  was  1 .5  cm)  was  closer  to  the  surface  as  observed  from 
our  and  other  researchers’  prior  studies.4'19  The  y-z  (2D)  lo¬ 
calization  of  the  reconstructed  target  was  slightly  off  from 
the  true  location  (1.12  cm),  and  this  could  be  from  experi¬ 
mental  error  during  target  placement,  since  only  a  single  tar¬ 
get  was  reconstructed  without  any  artifacts.  Currently,  alter¬ 
nate  imaging  approaches  and  reconstruction  techniques  are 
developed  in  the  laboratory  to  improve  the  accuracy  in  target 
depth  recovery  during  tomography  studies. 

From  these  preliminary  studies,  feasibility  of  3D  tomog¬ 
raphic  imaging  using  coregistered  measurements  from  a 
hand-held  based  optical  imager  has  been  demonstrated.  In  a 
recent  study,  3D  tomographic  imaging  using  the  same  hand¬ 
held  based  optical  imager,  but  manually  coregistered  fluores¬ 
cence  measurements,  has  been  demonstrated  under  various 
experimental  conditions,4  and  hence  only  one  experimental 
case  is  described  here  as  an  example.  Reproducibility  tomog¬ 
raphy  studies  are  currently  carried  out  using  the  automati¬ 
cally  coregistered  imaging  system. 


peated  images,  which  indicates  that  either  the  probe’s 

527  position/orientation  jitters  in  the  few  seconds  between  the 

528  five  repetitions,  or  that  there  are  instrument  errors. 

529  B.  Tomographic  imaging  using  coregistered 

530  measurements 

531  As  previously  mentioned,  coregistered  imaging  can 

532  greatly  facilitate  tomography  by  allowing  the  location  of  an 

533  image  to  be  known  with  respect  to  the  tissue  surface.  A 

534  single  target  was  reconstructed  when  inversions  were  per- 

535  formed  using  coregistered  FD-based  fluorescence  measure- 

536  ments  obtained  from  a  single  scan.  The  reconstructed  target’s 

537  centroid  location  ([19.6,  13.6,  6.0]  cm)  was  close  to  its  true 

538  location  of  [18.5,  14.6,  6.5]  cm  as  shown  from  the  3D  isos- 

539  urface  plot  in  Fig.  7  and  also  quantitative  analysis.  Since 

540  only  reflectance-based  measurements  were  used,  the  target 

541  depth  recovery  (0.4  cm  from  reconstructions,  when  the  true 


C.  Coregistered  imaging  toward  improved  target 
depth  detection 

Figure  8  shows  individual  coregistered  2D  contour  im¬ 
ages  from  six  different  locations  of  the  cubical  phantom  face 
that  is  closest  to  the  target  (located  3  cm  deep  from  this  y-z 
face).  It  can  be  seen  from  these  images  that  in  single  coreg¬ 
istered  scans,  a  3  cm  deep  target  is  not  clearly  differentiable 
from  the  background.  However,  when  the  summed  coregis¬ 
tered  data  are  presented  as  2D  contour  images  (see  Fig.  9), 
the  signal  strength  at  the  target  location  was  relatively  stron¬ 
ger  making  the  target  differentiable  from  the  background. 
This  is  possibly  because  the  background  noise  (or  artifacts) 
does  not  consistently  appear  in  every  scan  obtained  from 
varying  heights  of  the  same  phantom  face,  but  the  target 
does.  However,  the  target  being  located  deeper  (3  cm)  may 
have  a  weaker  signal  and  is  not  differentiable  from  the  back¬ 
ground  noise  from  a  single  scan.  Upon  summing  the  coreg- 


FIG.  8.  (Color  online)  Coregistered  surface  contour  images  of  fluorescence  intensity  (subtracted  and  normalized)  obtained  from  a  10  X  10  X  10  cm3  cubical 
phantom  containing  a  0.45  cm3  target  located  3  cm  deep  at  [3,  2.5,  2.8]  cm.  The  white  dotted  line  corresponds  to  the  hand-held  probe  location  on  the  imaging 
face  of  the  cubical  phantom  and  the  white  circle  corresponds  to  the  true  target  location  in  2D.  The  probe  was  moved  along  the  height  of  the  phantom,  with 
its  location  varying  in  the  increments  of  0.5  cm,  starting  from  x=0  cm  up  to  2.5  cm  [(a — (f)]. 
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FIG.  9.  (Color  online)  Summated  coregistered  data  shown  as  2D  surface 
contour  plot  of  fluorescence  intensity  obtained  from  the  surface  of  a  10 
X  10  X  10  cm-’  cubical  phantom  containing  a  0.45  cm  target  located  3  cm 
deep.  Six  coregistered  images  (shown  in  Fig.  8)  were  summated  in  this  case. 
The  white  circle  is  the  true  target  location  in  2D. 


578  istered  intensity  data  from  multiple  scans,  the  overall  inten- 

579  sity  at  the  target  location  increases  significantly  with  respect 

580  to  the  background  random  noisy  data.  Hence,  by  performing 

581  a  summation  of  real-time  coregistered  data  for  experimental 

582  cases  with  deeper  targets,  the  ability  to  detect  and  differen- 

583  tiate  these  targets  from  background  noise  is  improved  as 

584  demonstrated  from  these  preliminary  feasibility  studies.  The 

585  rough  estimate  of  target  location  can  in  turn  be  used  as  a 

586  priori  information  during  3D  tomography  studies,  possibly 

587  improving  the  target  depth  recovery,  especially  when  fluores- 

588  cence  measurements  are  obtained  from  multiple  locations 

589  and  faces  of  the  phantom. 


ated.  These  3D  surface  maps  will  be  uploaded  on  the  818 
matlab/labview  in-house  developed  software  toward  ac-  614 
quiring  coregistered  images  onto  the  (breast)  tissue  being  615 
imaged.  Some  of  the  challenges  in  the  clinical  translation  of  616 
this  hand-held  imager  include:  (i)  optical  measurements  can  617 
be  easily  contaminated  by  motion  artifacts  caused  by  patient/  618 
operator,  (ii)  the  relative  motion  of  the  probe  and  soft  tissue  619 
during  contact  imaging  (similar  to  ultrasound  probes  scanned  620 
in  2D  to  perform  3D  imaging)  making  coregistration  diffi-  621 
cult,  and  (iii)  patient  movement  during  imaging  can  generate  622 
inaccurate  coregistered  images,  and  in  turn  3D  tomographic  623 
images.  The  possible  solutions  to  overcome  these  challenges  624 
include:  (i)  developing  careful  operation  procedures  and  op-  625 
erator  training  will  be  developed  in  order  to  obtain  good  626 
quality  images  using  our  hand-held  based  optical  imager,  (ii)  627 
using  a  tissue  conforming  garment  to  aid  in  standardizing  628 
imaging  procedures,  over  imaging  directly  onto  the  soft  tis-  629 
sue,  and  (iii)  implementing  a  second  tracking  system  in  order  630 
to  minimize  misaligned  coregistration  issues  associated  with  631 
motion  artifact  (i.e.,  subject  movements).  Along  with  these  632 
ongoing  efforts  toward  clinical  translation  of  the  technology,  633 
the  computational  efficiency  of  generating  an  automated  634 
coregistered  image  (in  near  to  real  time)  is  parallely  635 
improved.  636 

Currently,  the  OIL  is  developing  a  second  generation  637 
hand-held  probe  with  a  smooth  curvature  based  probe  head  638 
design  such  that  it  can  better  contour  to  curved  tissue,  as  639 
opposed  to  the  current  hand-held  probe  that  has  a  three-piece  640 
segmented  feature  of  flexing.  All  these  advancements  in  the  641 
area  of  hand-held  based  optical  imagers  will  empower  clini-  642 
cians  to  perform  real-time  coregistered  optical  imaging  on-  643 
site  using  a  portable  imaging  device  (similar  to  ultrasound)  644 
toward  initial  assessments  of  the  tissue,  followed  by  exten-  645 
sive  tomographic  analysis  toward  3D  tissue  characterization  646 
and  tumor  localization.  647 


590  IV.  CONCLUSIONS 

591  An  innovative  coregistration  technique  has  been  devel- 

592  oped,  first  of  its  kind,  and  implemented  onto  a  hand-held 

593  probe-based  optical  imager  such  that  surface  coregistered 

594  measurements  are  obtained  toward  improved  target  detection 

595  and  3D  tomography  studies.  Continuous-wave  and 

596  frequency-domain  based  experimental  studies  were  per- 

597  formed  on  cubical  phantoms  to  demonstrate  the  feasibility  of 

598  2D  automated  coregistered  imaging  and  3D  tomographic  im- 

599  aging,  respectively.  The  coregistered  optical  measurements 

600  from  multiple  scans  will  be  implemented  in  our  image  recon- 

601  struction  algorithms  in  order  to  obtain  3D  tomographic  im- 

602  ages  of  the  tissue  phantom  or  in  vivo  tissue.  Although  all  the 

603  current  experimental  studies  were  fluorescence  based,  auto- 

604  mated  (and  fast),  coregistered  and  tomographic  imaging  is 

605  also  feasible  for  nonfluorescence  diffuse  optical  imaging. 

606  Since  the  probe  is  capable  of  curving  up  to  45°  on  each 

607  side,  in  vivo  studies  on  breast  tissues  are  feasible.  In  the 

608  future,  (near)  real-time  in  vivo  optical  imaging  studies  will 

609  be  performed  using  the  novel  hand-held  imager,  in  order  to 

610  assess  the  ability  to  coregister  the  hand  held  on  actual  tissue 

611  curvatures.  3D  laser  scanning  devices  will  be  used,  such  that 

612  3D  (discretized)  surface  maps  of  the  breast  tissue  are  gener- 
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APPENDIX:  AEKF  ALGORITHM  FOR  3D  IMAGE  655 

RECONSTRUCTIONS  656 

A  modified  version17'40  of  the  AEKF  algorithm14  was  657 
used  to  perform  the  3D  image  reconstructions.  The  method  658 
of  the  AEKF  algorithm  is  given  by  the  following  659 


pseudocode:  660 

iterate  661 

1:  x=/(y)  662 

for  i  =  1  to  #  source  illuminations  663 

2:  664 

dXj 

dy  665 

3:  K,=P  JL(R.+Q ,+J  -P  jT)  i  666 

4:  Ay,=K,-(z,-x,)  667 


1-10 


Regalado  et  al. 


Rev.  Sci.  Instrum.  80,  1  (2009) 


DDO  5:  P<— P-K,-JfP 

669  end 

670  6:  y<-y+2Ay, 

671  until  convergence 

672  The  parameter  x  represents  the  distributed  predictions  of 

673  the  referenced  measurements  in  terms  of  the  logarithm  of  ac 

674  and  the  phase  shift,  which  are  generated  by  the  forward 

675  simulator  /.  The  parameter  y  represents  the  vector  of  current 

676  estimates  of  the  unknown  optical  property,  which  is  an  in- 

677  verse  pseudo-/!  transform  of  the  optical  absorption  coeffi- 

678  cient  due  to  the  fluorophore  ( /xaxf).  The  measurement  error 

679  covariance  was  assumed  uncorrelated,  and  repeated  observa- 

680  tions  (in  this  case,  five)  at  each  detector  location  were  used  to 

681  experimentally  determine  the  variance  for  each  source- 

682  detector  pair.  The  model  error  covariance  Q  is  difficult  to 

683  estimate  for  unknown  domains  and  was  empirically  chosen 

684  to  be  one-fourth  the  mean  of  the  measurement  error  variance. 

685  The  gain  matrix  K  for  each  point  illumination  i  was  deter- 

686  mined  using  the  measurement  error  covariance  R,  the  model 

687  error  covariance  Q,  the  parameter  error  covariance  P,  and 

688  the  Jacobian  matrix  J.  The  subscript  i  is  used  to  indicate  that 

689  the  vector  or  matrix  contains  only  data  associated  with  the 

690  illumination  source  i.  The  gain  matrix  K  is  used  to  update 

691  the  unknown  optical  parameter  y  and  the  parameter  error 

692  covariance  P.  An  initial  variance  estimate  was  set  to  0.01  for 

693  this  case  and  the  parameter  error  was  assumed  uncorrelated 

694  with  the  initial  estimate.  While  the  pseudocode  shows  P  as  a 

695  covariance  matrix,  in  this  implementation,  only  the  variances 

696  (diagonal  elements  of  P)  were  actually  stored  and  manipu- 

697  lated.  The  inversion  algorithm  used  here  differs  slightly  from 

698  the  AEKF  (as  reported  previously) 1  s  in  that  it  is  more  com- 

699  putationally  efficient.  Preliminary  studies  indicate  that  the 

700  modified  algorithm  has  the  same  or  greater  accuracy  as  the 

701  original  AEKF  algorithm.40  Additionally,  simultaneous  mul- 

702  tiple  point  sources  as  implemented  in  the  hand-held  probe 

703  design  were  taken  into  account  in  the  inverse  algorithm  dur- 

704  ing  3D  image  reconstructions.4 
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